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1. Introduction 


Many organizations are seeking ways to understand, demon- 
strate, improve and measure their environmental performance [1]. 
According to the ISO 14031, this can be achieved effectively by deal- 
ing with the features of its activities, such as products and services 
which have a significant impact on the environment. This impact 
can be measured through related indicators, such as the amount of 
energy consumed in manufacturing the products. With regard to 
industrial activities, the indicators were traditionally related to eco- 
nomic factors, such as cost, production and process efficiency, while 
failing to focus on environmental areas [2]. However, the efficient 
use of water and energy for their industrial units has led the indus- 
try to change its attitudes to already established schemes which, 
due to their operational success in terms of the need to optimize 
the use of natural resources, had not been questioned before [3]. 

Environmental performance can be defined as the "measurable 
results of the ability of an organization to handle environmental factors 
which can be, defined as those elements of an organization’s activi- 
ties, products or services that can interact with the environment, and 
have an impact on it” [4]. Environmental performance evaluation 
(EPE) is a process of internal management designed to facilitate 
decision-making, by making a selection of indicators to provide 
information for comparing the environmental performance of the 
past and present, and thus predict the possible trends in the future 
of an organization. 

The need for information about organizational performance 
has arisen for several reasons: compliance cost reduction regard- 
ing future requirements, the adoption of voluntary environmental 
codes, lower operating costs, improved relations with stakehold- 
ers, and finally, an awareness of the environmental visibility of 
the company as a competitive advantage [3]. The indicators can 
be used as an important measurement tool to display this informa- 
tion in a clear and objective way, to help meet these requirements 
[5]. As such, the indicators are the main tools of the ISO 14031 
for providing information about the environmental performance 
of organizations [6-16]. Lately, environmental indicators have thus 
been constructed and used as a tool to support environmental man- 
agement organizations [9,17-19,13,20]. One factor that is often 
neglected is the uncertainty of the measurements applied to the 
indicators, as well as the raw data used for their construction 
[21,19]. However, Perotto et al. [19] state that the uncertainty has 
affected the raw data and this is a crucial issue, since the indica- 
tors may provide a distorted image of the results when applied to 
environmental factors. 

This article sets out a methodology for calculating the energy 
indicators and estimates of uncertainty. The proposed methodology 
is based on the method outlined by GUM Guide to the expres- 
sion of uncertainty in measurement published by the International 
Organization for Standardization ISO (GUM [22]). This methodol- 
ogy was used to examine a large petrochemical industry located 
in the Industrial Complex of Camaari, in Bahia, Brazil. The results 
tend to support the company’s strategic decisions with regard to 
the calculation of indicator values. 


2. Indicators 


There are several definitions and characteristics of indicators 
that can be found in the literature. According to Perotto et al.[19], 
indicators are variables that summarize or simplify relevant infor- 
mation about the state of a complex system. Cantarino [23] defines 
indicators as useful information for decision-making, which means 
that one can infer the quality of a particular indicator by the 
quality of the information provided. According to Cardoso [4], 
indicators can be used as an important measurement tool to 
express information, clearly and objectively, and thus help meet 


this demand. They are management control tools that provide 
support for decision-making which are based on the relevant infor- 
mation and summarized in concise illustrative statements. The 
indicator can be considered a variable an operational representa- 
tion of an attribute (quality, characteristic, property) of a system 
[24]. It is usually calculated on the basis of historical observa- 
tions and reflects past behavior; this enables indicators to be 
used in the detection of trends, benchmarking and reporting on 
operational conformity with regard to any restrictions imposed 
and the achievement of best practices in environmental manage- 
ment. 

Indicators can provide either qualitative or quantitative infor- 
mation. Both are necessary and a complementary means of showing 
the environmental, economic and social performance of the orga- 
nizations. Although the use of quantitative indicators is highly 
recommended, it is not always possible to apply them to mea- 
sure performance, especially in the social field. Many social issues 
are subjective and the measurement of performance is not easily 
quantifiable [25]. Quantitative indicators are well-defined compo- 
nents and are thus more easily reproduced over time and have 
greater reliability in their information, while qualitative indicators 
are more susceptible to variations. 

According to Veleva and Ellenbecker [24] constructing an 
indicator involves adding a unit of measurement, the period of mea- 
surement, and boundaries. Environmental indicators can be shown 
in either absolute or relative terms, for example, as an expression 
that provides information that can be used to compare an organiza- 
tion’s environmental performance with its production. As well as 
these two forms of presentation, the standard [23,26,1,10,27,24]. 
As well as these two forms of presentation, the standard [28] pro- 
vides three examples of ways that environmental indicators can be 
classified: 


e Indexed - data or descriptive information converted into units or 
in a form that links the information to a chosen standard or frame 
of reference that is expressed in percentage (%) terms. 

e Aggregate - data or descriptive information of the same type but 
collected from different sources and expressed as a combined 
value, thus providing one or more environmental parameters of 
interest. 

e Weighted - expresses the degree of relative importance or impor- 
tance of the indicators of environmental performance. 


Hence, the use of indicators is a part of an ongoing evolutionary 
process that involves obtaining knowledge and requires a survey, 
analysis and interpretation of the data and processes. This can lead 
to transformation in the company by raising awareness and enter- 
ing a more worthwhile dialogue with stakeholders [24]. When 
collecting data that will supply the indicators with information, 
it is necessary to take into account its reliability, availability and 
validation in both phenomenological and statistical areas. 


2.1. Environmental indicators and environmental performance 
indicators 


A number of definitions of environmental indicators have been 
cited by different organizations. In the case of EPA (2003) the 
North American Environmental Protection Agency, an environmen- 
tal indicator is a numerical value derived from actual measurements 
of a pressure, state or ambient condition, exposure or human health or 
ecological condition over a specified geographic domain, whose trends 
over time represent or draw attention to underlying trends in the con- 
dition of the environment [29]. UNEP (2009) the United Nations 
Environment Programme defines environmental indicators as a 
way to improve the delivery of information for decision-making [30]. 
While for the Organization for Economic Cooperation and Devel- 
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opment, it is an essential tool for tracking environmental progress, 
supporting policy evaluation and informing the public [31]. 

In the case of an industrial environment, environmental indica- 
tors are important tools for measuring and displaying the results 
that enable life cycle assessment of the product to be made [32] This 
can help industry to obtain optimal operating points with regard 
to its environmental performance and support advances made in 
industry by taking action that can lead to effective improvements 
in sustainability. Looking at the issue in greater detail, according 
to Jasch [10] and Tsoulfas and Pappas [33], environmental perfor- 
mance indicators can be used in the following ways: 


e Highlighting the potential for optimization. 

e Achieving the environmental objectives of the company. 

e Identifying market opportunities and the scope for cost reduc- 
tion. 

e Evaluating the environmental performance of different compa- 
nies (benchmarking). 

e Acting as a communication tool for environmental reporting. 

e Providing technical support for environmental management sys- 
tems. 


A further feature of the indicators is that they: 


è Should be measurable, and thus verifiable. 

e Should help improve the decision-making process, after carrying 
out an overall assessment of a company’s operations, products 
and services. 

e Should also enhance benchmarking and monitoring over time, 
since companies have to modify their practices from time to time. 


Tsoulfas and Pappis [33] highlight two difficulties that have been 
encountered with the construction and use of environmental per- 
formance indicators. The first is the collection of data, especially 
when large systems are being examined, and the second is lack of 
data quality, leading to different approaches being adopted and a 
feeling that they do not produce a true and fair account of a process. 


2.2. ISO 14031 


This standard describes two general categories of indicators for 
environmental performance evaluation (EPE). 


2.2.1. Environmental performance indicators (EPIs). 
EPIs can be classified as: 


e Management Performance Indicators (MPIs): these are types of 
EPIs that provide information on the efforts made by the man- 
agement to influence the environmental performance of the 
organization’s operations. 

e Operational Performance Indicators (OPIs): these are types of EPIs 
that provide information about the environmental performance 
of the organization’s operations. 


2.2.2. Environmental condition indicators (ECIs) 

ECIs provide information that can help the organization to have 
a better understanding of the impact or potential impact of its 
environmental policies and thus help in the planning and imple- 
mentation of the EPE. Table 1 shows some examples of indicators 
used for assessing the environmental performance found in stan- 
dard ISO 14031. 


Table 1 
Examples of indicators for EPE (ISO 14031). 


Category Classification 


EPIs MPIs 


Examples 


Operating and capital costs associated with the 
environmental aspects of a process or product 
Return on investment in environmental 
improvement projects 

Number of objectives and targets 
environmentally achieved 

OPIs Quantity of energy used per year or per unit of 
product 

Quantity of water reused 

Quantity of water per unit of product 


ECIs ECIs Concentration for monitoring of a given 
contaminant, in air, at selected sites 
Dissolved oxygen in receiving bodies 
Concentration of selected nutrients in the soil 


adjacent to the premises of the industry 


3. Initiatives taken in the use of environmental 
performance indicators for EPE 


Diakaki et al. [7] recommends a method based on the principles 
of risk assessment (a basic technique in environmental protec- 
tion and management), to assist organizations in selecting the 
most appropriate indicators for the assessment procedures of their 
environmental performance. The main advantage of applying this 
method is that it makes it easier to carry out an evaluation of envi- 
ronmental performance by putting emphasis on one of the most 
important steps required to decide what specific indicators should 
be taken into account. Hermann et al. [9] use a combination of three 
tools (LCA - analysis of the life cycle, MCA - multi-criteria analy- 
sis and EPIs - environmental performance indicators) to provide 
information about the evaluation of environmental impacts applied 
in improving the environmental performance of an pulp industry 
in Thailand. Integrating these three tools allows for an assess- 
ment which is complete in that it includes parts of the production 
chain that are outside the boundaries of the industrial system itself, 
resulting in indicators which are easy to interpret for policy pur- 
poses with readily available information. From a methodological 
point of view, a disadvantage of this new combination of tools may 
be the fact that the LCA is not fully carried out. However, a full LCA 
may not be needed for companies that are primarily interested in 
the part of the system they control, i.e. the on-site processes as well 
as the preceding production chain on which they have influence 
through their choice of suppliers. Saengsupavanich et al.[13] used 
environmental performance indicators to assess the environmental 
performance of the Industrial Estate Authority of Thailand (IEAT) as 
a means of regulating the Map Ta Phut (MTP) port and industrial 
estate. Johnston and Smith [11] put forward a model based on two 
methods to devise indicators that can be applied by managers of 
water companies. The first method consisted of semi-structured 
interviews with managers of the water company. The second con- 
sisted of a survey conducted by e-mail with the managers of the 
environmental industry. The model suggested that there was aneed 
to investigate the link between environmental issues, environmen- 
tal management systems and the development of indicators, types 
of goals and objectives, and management style and the use of indica- 
tors as a tool for public relations. Henri and Journeault [8] mention 
the importance of the following: measuring environmental perfor- 
mance through the use of environmental performance indicators 
to support organizations in communicating environmental strate- 
gies, supporting and ensuring Environmental Compliance, assisting 
in obtaining and maintaining ISO 14001 certification, adopting 
formally complex environmental processes and procedures and 
providing data for external reporting in manufacturing companies 
in Canada. BertrandKrajewski et al. [21] conducted an assessment 
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of uncertainties with regard to performance indicators, through 
two case studies into stormwater facilities. Both cases show that 
the uncertainties are very significant and should be included in the 
calculation and use of performance indicators. These researchers 
point out that there has been little research into the use of envi- 
ronmental performance indicators for decision-making which are 
based on the quality of the raw data. 


4. Importance of indicators as a tool for decision-making 


According to Andrade [34], one of the factors that can complicate 
rational decision-making is uncertainty. Most decisions, particu- 
larly the most important, are made on the basis of some kind of 
prediction, which, in itself, puts the uncertainty factor into the deci- 
sion process. Even if the problem does not require any evaluation 
to be made, another complicating factor is the lack of information. 
Thus one of the main difficulties encountered by decision-makers 
in companies - such as questions concerning how to invest and 
why, how to prioritize and what the returns on investments in the 
environment should be - is the lack of knowledge and information 
available for dealing with complex issues. Olsthoorn et al. [12] argue 
that decision-making and the management of complex issues in the 
industrial environment, requires the use of indicators to represent 
what these issues are. Thoresen [14] states that in practice environ- 
mental performance indicators can be used for decision-making by 
interested parties, both outside the organization (at a macro level) 
and at different levels of organization within the company (at a 
micro level) and that this can gradually reduce the harmful environ- 
mental impacts of products and processes. External stakeholders 
need a set of environmental performance indicators (applied on 
a large scale) to enable them to exert pressure on businesses and 
thus ensure that improvements are planned and implemented on 
an ongoing basis. Berkhout et al. [6] argues that environmental per- 
formance indicators can be used by stakeholders in business in the 
following ways: 


e Banks and insurers can examine the environmental performance 
indicators to assist companies in evaluating long-term economic 
risks. 

e Fund managers use environmental criteria to address demands 
for the incorporation of environmental concerns and ethical 
issues in investment decisions. 

e Those responsible for policymaking can evaluate the effective- 
ness of different policy devices in improving the environmental 
performance of companies. 

e Researchers can analyze the design and trends to improve our 
understanding of the causes of high and low environmental per- 
formance. 


5. Quality of raw data to construct indicators 


According to BertrandKrajewski et al. [21], only a few studies 
about performance indicators address the following issues: 


e Evaluation of the quality and the credibility of results obtained 
through an estimation of performance indicators. 

e Evaluation of the impact of the quality of the indicators on deci- 
sions that have to be made. 


Nordheim and Barrasso [18] and Von Bahr et al. [32] assess 
the importance of data quality indicators to measure the operat- 
ing performance for three types of emissions, dust, NO, and SO2 
as a limiting factor for benchmarking and to carry out an external 
evaluation of six cement plants in Sweden, Norway and Finland. The 
author highlights the importance of the need to take into account 


the reliability, availability and ability to validate the scientific and 
statistical data when comparing the environmental performance of 
two companies. 

Perotto et al. [19] state that measuring the organization’s envi- 
ronmental performance remains one of the great difficulties for the 
organization and certification/bodies responsible. The question of 
the link between measurement uncertainty and the indicator can 
be a competitive differentiator, because the environmental perfor- 
mance indicators are used by companies for benchmarking which 
means that environmental performance indicators which have a 
lower degree of uncertainty will inspire greater confidence among 
the stakeholders. When there is a maximum or minimum level 
for the indicator, whether established by legislation or otherwise, 
the degree of uncertainty becomes an essential factor in assessing 
the likelihood of error or accuracy in decision-making. The uncer- 
tainty of the indicator is also a valuable tool to use to allow the key 
components that influence the final quality of the indicators to be 
identified. On the other hand, if the degree of uncertainty of the 
indicator is unknown, a change in its value may be due to natural 
variability in the process of planning and implementing changes 
and this can increase the probability of making wrong decisions. 


6. Measurement uncertainty 


The term uncertainty is closely linked to the concept of doubt. 
The uncertainty of the measurement is nothing more than a doubt 
regarding the measurand (a particular quantity that is subject to 
Measurement) at the time when the measurement is carried out. 
Uncertainty can be understood as a measure of quality measure- 
ment [35]. Thus, it can be said that the smaller the uncertainty, 
the better the quality of the measurement. It is evident that the 
Measurement result is the best evaluation of the measurand, and 
that all the components of uncertainty, including those arising from 
systematic effects, such as components associated with corrections 
and reference standards, contribute to the dispersion. 

The uncertainty of the result of a measurement reflects the lack 
of a complete knowledge of the value of the measurand. The result 
of a measurement after correction of the known systematic effects, 
is still only an evaluation of the value of the measurand because 
of uncertainty arising from the extent of random effects and the 
imperfect correction of the result of systematic effects, both of 
which can never be fully known. Therefore, the result of measur- 
ing or calculating a magnitude represents only an approximation of 
the value of the measurand and to be complete it must be accom- 
panied by a statement of measurement uncertainty. According to 
the International Vocabulary of Basic and General Terms in Metrol- 
ogy VIM [36], the uncertainty of measurement generally comprises 
many components. Some of these components can be evaluated on 
the basis of the statistical distribution of the results of a series of 
measurements and can be characterized by experimental standard 
deviations. The other components, which can also be characterized 
by standard deviations, are evaluated by the assumed probability 
distribution, based on experience or other information. To avoid 
the occurrence of duplications of the uncertainties associated with 
measuring, it is necessary to adopt a structured and detailed pro- 
cedure. VIM recommends the use of the cause and effect diagram, 
also known as the Ishikawa diagram, to achieve this goal. 

Several methods have been used to determine the measurement 
uncertainty. One method that is widely accepted by accredita- 
tion bodies, is GUM which lays down general rules that must be 
adhered to by metrologists involved in quality measurement from 
the shop floor to in-depth research, to evaluated the measurement 
uncertainty of the measurand. In addition, GUM sets out a proce- 
dure, which is widely believed to propagate uncertainties in inputs 
(measured variables) for the output quantities (variables that are 
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calculated through a model). The measure is generally straight- 
forward in evaluating the indicator when it is absolute, and the 
uncertainty of the input is the very uncertainty of the indicator. 
On the other hand, when these are indicators of two or more input 
quantities, they are measured directly and their uncertainties must 
be propagated to the output quantity; in other words, the uncer- 
tainty of the relative indicator always of the in the form of the 
composition of the uncertainties of the input. 


6.1. Evaluating standard uncertainty 


When evaluating the measurement uncertainty, GUM reflects 
the propagation of the uncertainties of the influence quantities 
through a mathematical model that represents the measurand: 


Y = f(X1,X2,...,Xn) (1) 


where Y represents the output quantity and X; the input quan- 
tities. Each input evaluated and its associated combined standard 
uncertainty are obtained from a distribution of possible values of 
the input quantities. This probability distribution can be based on 
the frequency, that is, a series of observations, or may be an a pri- 
ori distribution. Uncertainties called Type A are calculated from a 
series of independent repeated observations and is the familiar sta- 
tistically evaluated experimental standard deviation of the mean, 
while the uncertainties called Type B, are obtained by means of a 
series of observations other than statistical analysis, in other words, 
is obtained from an assumed probability density function based on 
the degree of belief that an event will occur. 


6.1.1. Type A standard uncertainty 

The uncertainty of Type A is evaluated on the basis of the 
randomness of the sample values. Where possible sources of ran- 
domness originate from human actions, the environment and 
process itself on the measurement system. Hence, a good evalu- 
ation for this type of uncertainty is provided by the experimental 
standard deviation of the mean, which can be represented by Eq. 


(2). 


n 


Soe - 4 /n-1 


n—-1 n-1 k=1 
w= is (et Ja (2) 


where Sz characterizes the dispersion of the results, qg represents 
the result of the k th measurement and q represents the arithmetic 
mean of n results considered. The term before Sj is the correction 
of Bayes, according to Kacker et al. [37] 


6.1.2. Type B standard uncertainty 

Beyond the intrinsic variability of the measurand, there is the 
variability that is added by the measurement system. It is desirable 
that the measurement systems have the smallest possible, i.e. negli- 
gible, effect on the measurand, although it is necessary to evaluate 
this component of uncertainty before stating that it is negligible. 
This component of uncertainty is called GUM uncertainty Type B. 
The Type B evaluation of uncertainty uses means other than the 
static analysis of a series of repeated measurements at the time of 
the test. According to GUM, the proper use of all available informa- 
tion for a Type B evaluation of standard uncertainty can be obtained 
through the following: experience and knowledge, which can be 
achieved from practice, performance measurement based on the 
historical data method, uncertainties inherited from the calibra- 
tion equipment and standards, and the range of environmental 
conditions, among others. 

The most direct, though not necessarily the cheapest, way to 
evaluate uncertainty Type B, is available when there is a calibra- 


tion certificate of the measuring system. Ideally, this certificate 
should be issued by conducting experiments with instruments on 
the premises, which means that if you use a flow meter attached 
to an industrial chain, the calibration of the instrument should be 
performed in an operation on the factory floor during the manu- 
facturing process. 


6.1.3. Combined standard uncertainty 

The effects of the combined action of several sources of uncer- 
tainty should be quantified by the combined uncertainty [38,37]. 
GUM is employed to propagate the estimates, standard uncertain- 
ties and correlation coefficients of input quantities from a linear 
approximation of the model that links the quantities input with 
the output, using the Taylor series around their averages. The 
combined standard uncertainty considering all of the independent 
input quantities is given by: 


N of 2 
TODEA u(x) (3) 


i=1 


where, df/0x; is the sensitivity coefficients, and describes how the 
output estimate y varies with changes in the values of the input 
estimates x1, X2,...,Xy. Each is a standard uncertainty evaluated as 
described in Section 6.1.1 (Type A evaluation) or as in Section 6.1.2 
(Type B evaluation). When Eq. (3) is used to evaluate the uncertainty 
of a quantity measured directly, it takes the following form: 


(4) 


The estimated input x1, X2, ..., xy which makes a greater contri- 
bution to the value of the measurand will have the highest level 
of contribution, and therefore makes a greater contribution to the 
final uncertainty of y. For a comparison of the contribution of the 
uncertainties of the input variables, it is necessary to express the 
coefficient of contribution h(y, x;) on a relative scale (%) for com- 
bined standard uncertainty. Kessel et al. [39] set out the following 
expression as a factor contributing to the uncorrelated input vari- 
ables: 


0 2 
U(x) 


h(y, Xi) = FE (5) 


6.2. Expanded uncertainty 


The expanded uncertainty is the range around the measurement 
result which covers a large proportion of the probability distribu- 
tion, characterized by that result and its combined uncertainty. The 
expanded uncertainty U is obtained by multiplying the combined 
standard uncertainty u-(y) by a coverage factor k. 


U =k. uc(y) (6) 


The result of a measurement is then expressed as Y=y + U, where 
Y is the value assigned to the measurand, and y +U a y—U is the 
interval that is expected to cover a large fraction of the distribution 
of values that can be attributed to Y. The coverage factor must be 
calculated from the values of the number of degrees of freedom 
and the standard uncertainty of each source of uncertainty in Eq. 
(7) Welch-Satterthwaite(W-S). 


ud(y) 
N 
[ci u(x;)I* 
vi 


(7) 


Veff = 


i=1 
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Fig. 1. Coefficient of the contribution of the major component of EI. 


where Veg; is the effective degree of freedom, uc(y) is the combined 
uncertainty, u(x;) is standard uncertainty associated with the ith 
source of uncertainty, v; is the number of degrees of freedom asso- 
ciated with the ith source of uncertainty and N the total number of 
sources of uncertainties analyzed. 

The W-S formula provides an approximate solution to the prob- 
lem of determining the confidence interval for the measurand. 
Using the formula in determining the W-S, Ver the coverage fac- 
tor k can be evaluated by a Student’s t-distribution. The coverage 
factor not only depends on k( Veg, p), but also the confidence level 
(probability of coverage) p desired in the analysis of the expanded 
uncertainty. Thus, the coverage factor is called k(veg;, p) and the 
expanded uncertainty is expressed by U = kpuc. The value of k is sim- 
ilar to the tabulated values of Student’s t-distribution with effective 
degrees of freedom for a given level of confidence. The W-S formula 
depends on several hypotheses to be strictly valid: all the quantities 
must have normal PDF, all the input quantities must be indepen- 
dent and the linear approximation model of the measurand must 
also be appropriate ([22], clause 5.1.2 and 5.1.5). However, in most 
cases these assumptions are not fully met see Martins et al. [40] 
who outline a number of appropriate treatment alternatives for 
these situations. When the indicator is represented by a non-linear 
model or when the assumptions referred to above are not appro- 
priate, the application of the technique of Monte Carlo simulation, 
described in the GUM Supplement 1 and developed by BIPM et al. 
[41] and Martin et al. [40] is recommended. 


7. Case study 


The monitoring process in petrochemical industries is under- 
taken through the use of indicators calculated over periods of time 
and drawing on data from the process. The indicators show the 
times when the operation took place in a stable way and in times 
of highly variable production. 

In this study a method is used to evaluate the uncertainty of 
the energy indicator at a petrochemical unit. This energy indica- 
tor represents the amount of energy consumed in the production 
process. The goal of the company is to reduce the rate by 3%, with 
investment being made in projects and personnel. A reduction in 
this indicator can mean lower fuel consumption, less CO, pollution 
and a fall in production costs. Validation is an important stage in 
the evaluation of this indicator and it is necessary to calculate the 
uncertainty to ensure that 3% represents a significant reduction in 
fuel and production costs. We provide an estimate of evaluate the 


uncertainty of the energy indicator and its sensitivity to changes in 
the operation process. The structure of the indicator was displayed 
in a spreadsheet to help evaluate the uncertainty of the indicator 
as well as its sensitivity to each of the components of the model. 


7.1. Energy indicator 


The energy indicator (EI) has been used to monitor the energy 
consumption relative to the rate of production in the period. The 
study of uncertainty arose from the need to optimize the produc- 
tion of inputs, with regard to reducing energy consumption for a 
possible operating point and has achieved real results. According 
to ISO 14031, EI can be categorized as an indicator of operating per- 
formance and classified as an aggregate, composed of the sum of 
17 components in the numerator (CN) with 27 components in the 
denominator (CD) of various sources (Eq. (8)). 


The main feature of the components of the numerator is that it 
should be used in the generation or transmission of energy entering 
the volume control of the company, since the denominator refers 
to the products that are stocked or sold. Each component is the sum 
of the value from thee measuring device that monitors the stream 
in real time, Fig. 2. 


7.2. Applying the GUM methodology 


The procedure used to evaluate the uncertainty followed the 
recommendations of GUM, as described in Section 6. The evaluate 
of uncertainty was based on the method for propagation of uncer- 
tainties of input quantities (CN and CD) for the magnitude of output 
(EI). In each quantity, the input was regarded as comprising the 
contributions of Type A (Eq. (2)) and Type B uncertainties, where 
the former concerns process variability and the latter the quality of 
Measurement. 

After identifying the model (Eq. (8)), we adopted a procedure 
to evaluate the sources of uncertainty, as well as the Type A and 
Type B uncertainties. The uncertainty is dependent on the behav- 
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Table 2 
Source of measurement uncertainty and uncertainty values Type B. 


Source of uncertainty Uncertainty (%) 


Orifice plate 3.50 
Measure mass 0.80 
Orifice plate 4 holes 2.00 
Tank 0.20 
Gases 1.00 
Liquid 0.70 
Steam 2.00 
Eletricity input 1.00 
Eletricity output 1.00 
Table 3 
Estimation of uncertainty of Type A gas fuel. 
Daily production of gas fuel (kg/day) 50.9E+05 
The mean of the uncertainties Type A (kg/day) 50.9E+04 
Combined uncertainty of fuel gas produced (kg/day) 1.0E+05 


Coefficient of variation of the combined uncertainty of the 2.0 
fuel gas or relative uncertainty (%) 


ior of industrial production and will thus fluctuate over a period of 
time. Therefore of this, we chose a fixed day which the engineering 
dept regarded as suitable for providing stable conditions. An elec- 
tronic spreadsheet was prepared to allow some future changes in 
the variable values used in this research. 

The Type A uncertainties of CN and CD should be 
obtained by analyzing the data by means of a measure- 
ment device used in the operating process. Nevertheless, 
there are more than 1000 measurement devices which 
means that conducting an analysis of all the measurement 
devices in industry would be an arduous task. In view of this 
, we conducted an accurate analysis of the most important compo- 
nent and we treated the uncertainty of Type A of the measurement 
devices of the other components as the mean of the uncertainty 
of the important component. The most important component is 
fuel gas which makes up 70 % of all the energy consumed in the 
industry. The contribution of the indicator for each components is 
represented by the coefficient of the contribution [40] (Fig. 1). 

It is important to bear in mind that the structure of the indicator 
is the most important part at this stage because it allows changes to 
be made in the values when doubt exists. The Type A uncertainties 
were evaluated with the aid of Eq. (2) and the data were measured 
each second. 

The analysis of Type B uncertainties is used to find out about 
the measuring device used in the measurement. We analyzed the 
measuring devices and a table was prepared to show the typi- 
cal uncertainties that are caused by the petrochemical industry in 
question. This Table is already being used in the data reconciliation 
and on-line process optimization of the industry. Table 2 displays 
the sources and their related uncertainties. The uncertainty values 
of the orifice plate meter and mass were evaluated on the basis 
of the average values found in the internal research (reports of the 
operation). The uncertainty values of inputs coming from the tanks, 
gas, liquid, steam sales, electrical supplies were drawn from the 
monthly reports. 

All these factors were evaluated through the combined standard 
uncertainty (Eq. (3)) of CN and CD, and took account of all the input 
variables of the independent model (Eq. (8)). The degree of free- 
dom is calculated using the Welch-Satterthwaite equation (Eq. (7)), 
which treats the probability density functions of the components 
of the numerator and denominator as normal and independent. 

The analysis of the Type A uncertainties of the fuel gas is 
achieved by identifying all the fuel gas meters and the information 
flow values collected by the company. Table 3 shows the estimate 
of Type A uncertainty for the fuel gas. 


The evaluated of the uncertainty of the indicator of energy 
consumption per ton of petrochemicals produced is based on the 
contribution of process variability (uncertainty Type A) and quality 
Measurement (uncertainties Type B). From the data obtained, we 
also raised the degree of freedom, considering 30 measurements 
for each meter, thus implying a degree of freedom of 29. By apply- 
ing the Welch-Satterthwaite formula (Eq. (8)), we calculated the 
degree of freedom of each component and then the overall indica- 
tor, and obtained a value of 333 for the degree of freedom. With the 
degree of freedom at a confidence level of 90% a coverage factor of 
2 was obtained. In this context, due to poor knowledge about the 
uncertainties, several scenarios arose ranging from the uncertain- 
ties Types A and B for the input quantity, and seven possibilities 
were obtained which are displayed in Table 4. 

From Table 4 it can be observed that, if scenario 1 is adopted, 
the energy indicator can be shown as: 


EI = (20.0 + 0.2) 


(9) 


where the number following the symbol + is the numerical value 
of U=k. uc, an expanded uncertainty, with U given by uc =0.1 GJ/t, a 
combined standard uncertainty and a coverage factor k = 1.67 based 
on the t-distribution for ver=69 degrees of freedom. U defines an 
interval evaluated to have a 90% confidence interval. 

Alternatively, if scenario 7 is adopted, the energy indicator can 
be shown as: 


EI = (20.0 + 0.8) 


(10) 


where uc changes to 0.5 GJ/t and k to 1.65 based on the t-distribution 
for Vere = 361 degrees of freedom for the same 90% confidence inter- 
val. 

Fig. 2 shows the main components that contribute to a quanti- 
tative calculation of the JE and thus influence the final uncertainty 
of the indicator. A sensitivity test of the indicator based on Eq. (5) 
shows that the component of the calculation that most influences 
the final value of uncertainty is the fuel gas. This means that it is 
these meters that most need to be improved so that the uncertainty 
indicator can be significantly reduced. 

The process of estimating the uncertainty was influenced by the 
method of calculating the daily flow. Before the system was imple- 
mented for the reconciliation of the corporate data, this calculation 
was based on information that had been memorized throughout the 
day. After the implementation of the reconciler, this information 
was collected every minute, and after this its value was calculated 
on the basis of the number of minutes of the day. These two proce- 
dures were tested in the evaluated daily flow rate of a variable and 
little difference was observed between the two forms of calculation. 

The chart above (Fig. 2) shows the values measured minute by 
minute and the mean throughout the day (black horizontal line). 
Using the first calculation (information that had been memorized 
throughout the day), the value at the end of the day of production 
is calculated by integrating the area within the curve of the flow 
of fuel gas; this would be the measurement of the total amount 
in the second format of the calculation (after the implementation 
of the reconciler) which is obtained through the mean daily flow 
rate and then multiplied by the time interval required for collecting 
information. The sum of the area is shown below the black line. The 
results of both procedures are described in Table 5. 

This result shows that the two ways of calculating the daily flow 
are very close. The same procedure was adopted in this paper as 
was used in the reconciliation of data - the daily flow from the 
multiplication of the average flow time interval of interest. 

In discussions with the engineering team (operational, moni- 
toring and instrumental) a consensus was reached that the most 
realistic and safest scenario is the 7, which means that the uncer- 
tainty that the company adopted for the energy indicator was 
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Table 4 
Scenarios for estimating uncertainty of EI. 
Source of uncertainty Scenarios 
1 2 3 4 5 6 7 
Orifice plate (Type B) 3.5% 3.5% 3.5% 7.0% 7.0% 7.0% 7.0% 
Mass (Type B) 0.8% 0.8% 0.8% 1.6% 1.6% 1.6% 1.6% 
Orifice plate 4 holes (Type B) 2.0% 2.0% 2.0% 4.0% 4.0% 4.0% 4.0% 
Tank (Type B) 0.2% 0.2% 0.2% 0.4% 0.4% 0.4% 0.4% 
Gas (Type B) 1.0% 1.0% 1.0% 2.0% 2.0% 2.0% 2.0% 
Liquid (Type B) 0.7% 0.7% 0.7% 1.4% 1.4% 1.4% 1.4% 
Steam (Type B) 2.0% 2.0% 2.0% 4.0% 4.0% 4.0% 4.0% 
Electricity (input) (Type B) 1.0% 1.0% 1.0% 2.0% 2.0% 2.0% 2.0% 
Electricity (output) (Type B) 1.0% 1.0% 1.0% 2.0% 2.0% 2.0% 2.0% 
Uncertainty of fuel gas (Type B) 3.5% 3.5% 7.0% 7.0% 7.0% 7.0% 7.0% 
Type A uncertainty of all variables 1.0% 2.0% 1.0% 1.0% 2.0% 4.0% 10.0% 
Expanded uncertainty of the energy indicator (%) 1% 1% 1% 1% 2% 2% 4% 
Expanded uncertainty of the energy indicator (GJ/t) 0.2 0.2 0.2 0.3 0.3 0.4 0.8 
Value of the energy indicator (GJ/t) 20.0 


Note 1: 
Note 2: 
Note 3: 
Note 4: 
Note 5: 
Note 6: 
Note 7: 
fuel gas type. 


0.14 


Flow of fuel gas (Kg/ min) 


0.00 


Scenario 1 - Type B uncertainty as used in the reconciliation of balance sheet data of hydrocarbons. 
Scenario 2 - Type A uncertainty double uncertainty Type A of the scenario 1. 
Scenario 3 - Type B uncertainty of the fuel gas twice the uncertainty Type B gas fuel of the scenario 1. 

Scenario 4 - Type B uncertainties of all the instruments twice the uncertainty Type B of the scenario 1. 

Scenario 5 - Type B uncertainties of all instruments and uncertainty of Type A double uncertainty Type B and Type A, respectively, of the scenario 1. 

Scenario 6 - Type B uncertainties of all the instruments double the Type B uncertainty and Type A uncertainty quadruple the uncertainty of Type A of the scenario 1. 
Scenario 7 - MORE LIKELY SCENARIO - Type B uncertainties of all the instruments twice the uncertainty Type B and type the uncertainty Type A is the uncertainties 


21:00:00 23:23:00 01:47:00 04:11:00 05:35:00 08:59:00 11:23:00 13:47:00 16:11:00 18:35:00 20:59:00 


Period 


Fig. 2. Chart with the measures minute to the minute of the gas fuel. 


Table 5 
Calculation of averages by two procedures. 
Mean flow (kg/min) 0.09972 
Time interval (min) 1441 
Daily flow using the mean rate multiplied by the time interval 143.7018 
(kg/day) 
Daily flow by the direct sum of the flows minute by minute 143.4032 


(kg/day) 


(20.0 + 0.8) GJ/t, or in other words, 4% of the measured value. This 


result has changed the way the company sets its goals for improv- 
ing efficiency, because it was found that whether or not these goals 
could be met, merely depends on the variability of the process 
because they were within the range of uncertainty of the indicator. 


8. Conclusions 


The evaluation of data quality for obtaining the kind of environ- 
mental indicators that are most appropriate for a given process is 
one of the most important stages in the correct interpretation of an 
indicator of environmental or operational efficiency. 

The methodology based on GUM offered here for the evaluation 
and assessment of uncertainty when applied to a power indica- 


tor at a petrochemical company, has led us to reach the following 
conclusions: 


e It can be assumed that the most likely 7° scenario is 4% of the 
value of the indicator or 0.8 GJ/t, based on calculations made in 
January 2008 and that it had an EI of 20.0 GJ/t. 

e The most important component in estimating the uncertainty of 
the indicator is the flow of the fuel gas. 

e It is important to raise measurements involving the variability 
of the process because, in addition to improving the value of the 
indicator, it can help to lower the uncertainty of this indicator. 


In general, when evaluating the performance of an organization 
through indicators, a tool used for decision-making must take into 
account their uncertainty, even in an industrial environment where 
there is variability in the process. Hence, it is essential to obtain the 
knowledge of how the indicator is constructed and to be aware of 
its limitations in measuring the quality of each of its components. 
In other words, it is essential to evaluated the uncertainty of each 
component of the indicator and the propagation of the uncertainty 
of the indicator itself. 
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The case study was undertaken in an industrial environment 
which is reasonably under control and subject to less variability 
than in other media. This shows that the uncertainty of the indicator 
is significant and should not be assumed to be negligible. In other 
environments, where the operational conditions or environment 
cannot be controlled or known, the indicators, be they relative or 
absolute, should have an even greater uncertainty. In view of this, it 
is recommended that the uncertainty of the indicators be evaluated 
in any situation or the wrong decisions may be taken. 
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